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Abstract 

The purpose and objectives of control charting are reviewed. Control is defined as 
proper action in response to the observation of unexpected behaviour relative to 
defined limits about an expected value or mean. Precision and accuracy control 
are differentiated and discussed in terms of simple and complex statistical control. 
The advantages of a dual control system for verifying calibration control status 
between-run are presented. With the aid of two control standards proper control 
action can be taken based on knowledge of proper system function and experience 
with respect to probable cause and most appropriate solution. 



The Principle of Control Charting 



Introduction 



Control carries with it the implication of action in response to an observation. It is 
something that is imposed rather than mere happenstance. Control implies the 
existence of an expected value and of some limitation to the amount of deviation 
from expected. A simple temperature measurement device connected to a digital 
display would not be a control device. Even when it is connected to a strip chart 
recorder it is still not considered a control device until mechanical limits are put in 
place which cause an alarm to sound whenever the pen deflection exceeds a 
predefined amount. And if no one is around to hear and react to the alarm there is 
still no control. 

In the same way, an analytical process may be in a state of control, but it cannot 
be considered to be under control until the observations made have been plotted on 
a chart, and considered in the light of predefined limits. Even then, control has not 
been exerted until the human operator has made a decision based on the 
combination of observed fact, defined limits, and most importantly, other relevant 
factors. 

The strip chart temperature recorder on an incubator is required, not because it is 
connected to a control device, nor yet because it records individual values, but 
because it provides a performance record for later review and evaluation. Trends, 
or chronic malfunctions can be seen at a glance. The frequency, as well as the 
magnitude, of unexpected values is a valid indication of control status. Obviously 
deviations caused by someone opening the door cannot be considered as indicative 
of a control problem unless it is opened too frequently or left open too long. It is 
the supervisor's responsibility to decide correctly whether to call the serviceman or 
to speak to the staff. 

...2 



FIGURE 1: A RECORD OF OBSERVATIONS WILL REVEAL TRENDS 

AND VARIABILITY RELATIVE TO AN AVERAGE VALUE. 



VALUE 
MEASURED 



FREQUENCY 
DISTRIBUTION 




.AVERAGE 



SEQUENCE 



FIGURE 2: A CONTROL CHART DEFINES THE LIMITS OF 

ACCEPTABLE DEVIATION FROM AN EXPECTED VALUE 



VALUE *^ ( UPPER) 

MEASURED _ CONTROL LIMIT 
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warning limit 
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Figure 3: Control status is assessed by combining 
observations and control chart limits, 
the validity of the current limits should 
be evaluated in addition to data repeatability 
and bias of the average. 



VALUE 

MEASURED 




UPPER CL 



AVERAGE 
EXPECTED 



Db, 



AS 



LOWER CL. 



SEQUENCE 



-2- 



Clearly there is a difference between a data chart and a control chart. Figure 1 
represents a series of observed results plotted in time sequence. Figure 2 is a 
control chart. It includes an expected value and contoi limits. By imposing figure 
2 on figure 1 (see figure 3) we obtain an impression of relative Control Status. 

Figure 3 suggests that there is more involved to Control than simply calculating a 
control limit and plotting data. As shown, the limits seem far too wide compared 
to the current data set, and the average seems to be displaced from the expected 
value. One might (correctly) conclude that control is required over both the range 
of variation of individual values (precision), and the variation or drift of averages 
(accuracy). However before we discuss how to control, we should know 

a) what control means, 

b) what we are trying to achieve by control and control charting, 

c) the areas of operation that should be considered for control, and 

d) the relative priority of these areas in assuring final measurement quality. 

Definition of Control 

Control arises from Proper Action in Response to the Observation of Unexpected 
Behaviour Relative to Defined Limits about an Expected Value or Mean. 

Proper action will be based on Knowledge of Proper System Function and 
Experience with respect to Probable Causes and the Most Appropriate Solutions. 

Objectives of Control Charting 

1. To make You more familiar with the Actual Operating Characteristics of Your 
System, as operated by You. 

••••3 
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2. To provide a Readily Interpretable Record of the performance level achieved, 
for internal and external evaluation. 

Control Areas 

1. Equipment 

regular inspection and maintenance 

- passive control (self-limiting) 

2. Analytical Precision 

well-defined procedures 

- properly trained staff 

- passive control (self-limiting) 

3. Analytical Accuracy 

- properly prepared, traceable standards 

- well-defined calibration and standardization procedures 

- active control of standardization by means of control standards 

4. Analytical Recovery 

- known sample processing efficiency 

- well characterized samples 

- active control of sample processing by means of control samples 

Priorities for Control 

Measurement theory suggests that results obtained within a short period of time 
under standardized conditions will show a central tendency. They will not deviate 

...4 
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excessively from this central value with more than a defined probability. It is not 
the point of this discussion to describe how these limits are calculated or how the 
probability of exceeding a limit is determined. In the end it is essentially an 
arbitrary decision based on statistical theories which may, or may not, be 
appropriate. It is more important that we discuss the nature of control as it relates 
to measurement and to the decision making process. In particular the difference 
between precision and accuracy control must be clearly appreciated. 

Precision is a measure of the spread of individual values. Accuracy is a measure of 
the deviation of an average from an expected value. Ability :o detect inaccuracy 
is limited by the precision available only when insufficient data is included in the 
average. No statement can be made about either precision or accuracy given only 
a single value. Recent and historical patterns are essential to evaluating control 
status. 

As shown in figure ^a), precision and accuracy statements are always relative. 
Information is required as to what is acceptable, not only on an instantaneous but 
also on a continuous basis. Five shots closely spaced in a target may give an 
impression of precision. But if the marksman was only five yards from the target 
this may be unacceptable. 

If five shots are closely spaced and the sixth is not (e.g. point marked X) one must 
consider the marksman somewhat erratic. The point marked y is obviously not 
erratic. The more precise a procedure becomes the easier it is to identify suspect 
values. Fewer repeat measurements are required to confirm an outlier. 

It should be apparent from figure ^b) that it is not sufficient to be able to place 
shots precisely. One must be able to repeat this performance on successive trials. 



...5 



FIGURE 4: Precision^ bias, and accuracy can only be 

ASSESSED in TERMS OF PAST EXPERIENCE. 
CONTINUING CONTROL. AND A DEFINITION OF 
WHAT IS CONSIDERED ACCEPTABLE. 



A) 



precise? 



Imprecise? 



Shot from. . . 5 yards 
poor. 



...50 yards 
good. 



B) 



THIS MARKSMAN IS ACCURATE (l E . ON TARGET) 
PRECISION IS CONTROLLED, BUT BIAS IS NOT 
CONTROLLED. VhERE WILL HIS GROUPING GO NEXT? 





d) 



this marksman is inaccurate (le. off target) 
Precision is less controlled, but his bias 

IS WELL controlled. IF HIS SIGHTS ARE PROPERLY 
ADJUSTED HE CAN BE MADE AS ACCURATE AS NEEDED. 





^ 



PRECISION 

A MEASURE OF THE SPREAD OF INDIVIDUAL VALUES DUE TO 

- INHERENT WITHIN-RUN VARIATION OF MEASUREMENT PROCESSES 

- CONTROLLABLE BETWEEN-RUN VARIATION CAUSED BY THE 
STANDARDIZATION PROCESS 

REPEATABILITY = WITHIN-RUN EFFECTS ONLY 

REPRCD'JCISILITY^ DOT!! WITMIN AND BETnEEN-RuiN 



B^I A S 

VARIATION OF AN AVERAGE^ EITHER OVER TIME 

OR BETWEEN OPERATORS 

OR BETWEEN SYSTEMS / METHODS 

OR RELATIVE TO AN EXPECTED VALUE 

THE EXPECTED VALUE MAY BE DERIVED FROM A LONG TERM 
AVERAGE OR A BETWEEN-METHOD OR A BETWEEN-LAB AVERAGE. 



INACCURACY 

DEVIATION OF A LONG TERM (eTC.) AVERAGE FROM A 
DEFINED TRUE VALUE. 

THE DEFINED TRUE VALUE IS FREQUENTLY AN EXPECTED VALUE 
MADE OFFICIAL BY DECREE. IT's VALIDITY WILL THEREFORE 
OFTEN BE METHOD DEPENDENT. 



REPEATED MEASUREMENT WILL INCREASE ONE's CONFIDENCE IN 
THE AVERAGE VALUE OBTAINED. IT HAS NO EFFECT ON THE 
TRUTH OR ACCURACY OF THE AVERAGE. IT MAY IN FACT VERIFY 
ANY BIAS WHICH MAY BE PRESENT. 

ACCURACY IS NOT AN ABSOLUTE. IT DEPENDS UPON WHAT ONE 
CONSIDERS ACCEPTABLE. THEREFORE THE PHRASE 'oN-TARGET'. 
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However, even if the precision can be maintained it is not good enough if the next 
grouping of shots is located at a different spot on the target. 

Bias is usually introduced through operator error. If the gun sights are not adjusted 
correctly one will not expect the shots to arrive at the same location. If a 
different gun is used, a standard setting of the sights may not work. Calibration 
adjustments are always susceptible to Type I and Type II errors. The first is a 
failure to make an adjustment when one is required. The second involves failure to 
make a correct adjustment particularly when one is not required. 

In figure 4b) we assume the marksman is accurate because he is on target. His 
ability to control bias is not being tested sufficiently. If the target were smaller, 
or further away, he might have problems with accuracy. 

In figure ^c) we see a marksman who is inaccurate (off-target) but who is bias 
controlled. Readjustment of the sights would keep him on center. His precision is 
somewhat variable but this has little or no effect on the determination of bias or 
accuracy. 

It should be clear at this point that precision control and bias control are 
independent factors. One's ability to become and remain accurate depends more on 
the size of the target then anything else. However if the target is small, bias 
control becomes critical. Precision is relatively unimportant. Its importance 
increases as fewer and fewer shots are taken per grouping. 

Simple Statistical Control; Precision 

As long as we do not interrupt a measurement process by recalibration, or 
otherwise change the conditions of measurement, and as long as the process has 
been demonstrated to be rugged (i.e. relatively unaffected by small changes in 
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procedure), it is safe for us to "act for the moment as if the process is in a state of 
statistical control". Every time we repeat the process we can expect more or less 
the same result. Small changes at various stages in the process will tend to have 
random small effects on the result. On average these will tend to cancel out. 

Statistically this means that any given average calculated from a small amount of 
data will tend to be a good estimate of the 'true average' under existing conditions. 
It also implies there is a low probability that any given result will differ greatly 
from the average. The range of deviation likely to be observed can be estimated as 
some factor (often 3) times the 'standard deviation' (s). Given a series of repeated 
measurements (Xj, X2, X^), s is calculated by the formula 



s 



2 ^ ixf - (Zx//n 



n- 1 



Given a series of duplicate results s can also be calculated by 



.2 , :^(^i-X2)f ^ Z(D) 



2 



2k 2k 

where k is the number of duplicate pairs and D is the difference between the paired 
values. 

It is important to realize that s can be calculated for any available data set. 
However, its suitability for predicting the likely range of deviation from an average 
requires that all results were determined under identical conditions and that the 
distribution of repeated results is approximately 'normal'. In other words the 

system must be in control. 

...7 
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Demonstrating Simple Statistical Control 



The essential ingredient in Simple Statistical Control is repeatability. The actual 
value measured is not a concern at this point. Analysis is usually performed as a 
batch process. As long as the same reagents, digestion equipment, etc., are used 
and as long as the measurement instrumentation is stable and drift free there is no 
reason to believe that the average analytical response will change. Duplicate 
analysis of selected samples which represent the type routinely received can be 
used to demonstrate that Simple Statistical Control is actually occurring. 

A common approach to evaluating within-run control status from duplicates is to 
define an acceptable degree of difference (e.g. 10% or 0.25 mg/L) irrespective of 
the actual performance being achieved. This represents an acceptance limit 
approach. The alternative is to calculate of the standard deviation under routine 
conditions based on recent duplicate results. The control limit is then some factor 
times this standard deviation. Both approaches may permit a system to operate 
'out-of-control' for significant periods of time, since data obtained under 
uncontrolled conditions will not yield a valid control limit. 

A prime requisite for establishing a proper control limit is a system that is 
demonstrably in-control. Demonstration is most readily achieved by graphical 
techniques. A day to day plot of the difference between duplicates will indicate 
not only the instantaneous variability of differences but also, over the long-term, 
will show periods of time when differences are on average smaller than previously. 
At such times, a higher degree of control is being achieved. This is usually related 
to the use of a different batch of reagents, reserviced equipment, or staff rotation. 
Once this has been observed, control can be exerted over the factor that has been 
identified and more appropriate control limits can be determined. 
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It should be clear that both acceptance limits and control limits are useful. The 
former ensures a guaranteed level of service to the laboratory client while the 
latter ensures that periods of poorer control status are identified so that remedial 
action can be undertaken. There are dangers in the use of acceptance limits 
related to maintaining accuracy. This will be discussed later. When used in the 

/~rtn+OV+ r»f TM*^*"i c i/^n Ka etxM /try f anA-i + -«Vi;i;+i. A-f ^■•nll^n^Mr. ■i.l-l - :- •- _ _ — Li 
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Outliers on a day to day basis, as defined by the control limits, will occur 



a) because the sample is atypical of the routine for which the performance 
criterion was defined, 

b) the criterion is actually dependent on concentration and this factor has not been 
considered in defining it, 

c) an unusually large deviation has occurred, as expected (e.g. 1 in 20 or 1 in 200). 

d) an unusually large deviation has occurred because of an error in the analytical 
process, operational or instrumental problems, or individual sample processing 
error. 



If we can "act for the moment" as if the system is capable of control, and if we 
know that it has been in-control, and that no changes have been introduced a single 
instance of outliers must be carefully evaluated in terms of alternative explana- 
tions before one concludes that the process itself has failed. It is a characteristic 
of standard analytical procedures that gross total failure is highly unlikely. The 
judgement error of unnecessarily reanalyzing large numbers of samples because of 
a single instance of suspect repeatability is as serious an error as ignoring a control 
problem by failing to look for it. If the cause of the suspect data cannot be 
identified there can be no reason to believe that automatic reanalysis will provide 
data any more repeatabie than that already available. It could provide worse data 
if the system is indeed on the verge of failure. 
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One should always be cautious when responding to control problems identified by 
use of duplicate (or replicate) analyses, especially when they are borderline. 
Acceptance limits based on actual client needs should always be incorporated into 
the control program action plan to avoid unnecessary or incorrect control response. 
Repeatability control is properly a passive activity. It documents the performance 
level achieved, good or bad. It does not provide solutions. 

Figure 5 demonstrates a mechanism for observing the distribution and dependence 
of difference between duplicates on concentration. It usually reveals that a single 
criterion for controlling repeatability is inappropriate, 't can indirectly monitor 
the effect of time as points are added to the diagram on a day by day basis. Figure 
6 demonstrates the Range control chart approach based on time sequence. In both 
cases control limits are defined as a factor times the average range {difference 
between duplicates). However figure 5 accounts for the effect of concentration. 

Complex Statistical Control: Accuracy 

In order to report a result two principles are involved. There must be a measured 
response. But there must also be a calibration equation for converting the response 
to a concentration or other usable value. As already indicated, response can be 
assumed, for the moment, to vary in a statistically random fashion. However, it is 
not proper to make the same assumption with respect to calibration factors, 
because of the human element involved in deciding to accept or reject the data 
used to calibrate. Figure 7 shows how the response factor (sensitivit>^ might change 
from day to day. As shown, errors can be made in concluding that a significant 
change has, or has not occurred. 

When the same solution is measured on several different occasions the variation 
between results will be larger than predicted by random chance alone, because the 
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FIGURE 5\ The range of difference between duplicates 

is usually somewhat dependent on concentration. 
This method of accumulating data helps to show 
how control limits can be adjusted for this 
effect. a duplicate pair 0.017 and 0.021 would 
be added as a point in the box marked *. note 
the effect of r0undin6-0ff results on the 
apparent differences. 



20 



50 



ONCENTRATION AS ,«„ 
OF FULL SCALE. J-'-''-' 



.040 



CONTROL UMIT^ 

=3.257 X D/J 



.030 




DUPLICATES 



Figure 6: Typical range control chart. There is no 
allowance for the effect of concentration 

ON DIFFERENCE. TruE CONTROL STATUS IS 
DIFFICULT TO EVALUATE. HaS THE OBSERVED 
AVERAGE DIFFERENCE CHANGED RECENTLY? Or 
have we BEEN ANALYSING A LARGER THAN USUAL 
NUMBER OF HIGH LEVEL SAMPLES? 



Difference 

BETWEEN 
DUPLICATES 



.020 



.010 



.000 



UPPER CL 

=3.267 avg.diff. 




EXPECTED AVG.DIFF 



SEQUENCE 



PRECISION CONTROL 



•ASSUMES THAT ANALYTICAL CONDITIONS INCLUDING SYSTEM 
CALIBRATION REMAINS UNCHANGED 

■DEMONSTRATED BY ABILITY TO REPEAT ANALYSIS AND OBTAIN 
THE SAME RESULT WITHIN A NARROW RANGE OF VARIATION 

-SELF^LIHITI NG CHARACTERISTIC OF ALL STANDARD 
MEASUREMENT PROCESSES 

■LOW PROBABILITY THAT ANY REPLICATE RESULT WILL DIFFER 
GREATLY FROM THE AVERAGE 

-LOW PROBABILITY THAT CONTROL ACTION WILL BE REQUIRED 
UNLESS THE SYSTEM FAILS COMPLETELY 

-PASSIVE DATA COLLECTION AND EVALUATION IS USUALLY 
SUFFICIENT 

WE CAN ACT FOR THE MOMENT AS IF THE 
PROCESS IS IN A STATE OF "SIMPLE" 
STATISTICAL CONTROL. THEREFORE THE 
USE OF A CONTROL CHART IS HELPFUL 
BUT NOT ESSENTIAL. 

ACCURACY CONTROL 



■ASSUMES THAT ANALYTICAL CONDITIONS HAVE CHANGED AND 
THAT RESTANDARDIZATION IS REQUIRED 

-DEMONSTRATED BY A LARGER RANGE OF VARIATION BETWEEN 
RESULTS FROM DIFFERENT "RUNS" 

■INCORPORATES THE ERRORS IN PREPARING AND PROCESSING 
STANDARDS 

-THE RANGE OF VARIATION I S JLQX LIMITED BY CHANCE 

-HIGH PROBABILITY THAT ACTION WILL BE REQUIRED IN 
ORDER TO MAINTAIN CONTROL 

-REQUIRES ACTIVE DATA COLLECTION AND EVALUATION 



A CONTROL CHART IS REQUIRED TO KEEP 
THE PROCESS IN A STA 
STATISTICAL CONTROL. 



THE PROCESS IN A STATE OF "cOMPLEX" 



OBJECTIVES IN 
CONTROL CHARTING ACCURACY 



- TO ENSURE CONTROLLED BETWEEN-RUN VARIATION 

- TO IDENTIFY UNUSUAL CALIBRATION CHANGES WHICH 
COULD AFFECT ACCURACY 

- TO RECORD THE LEVEL AND STATUS OF CONTROL 
BEING MAINTAINED 

- TO DETERMINE AND CHARACTERIZE THE PARTICULAR 
TYPES OF CALIBRATION PROBLEMS TO WHICH THIS 
PROCESS IS SUSCEPTIBLE 

TO MAKE YOU 

FAMILIAR WITH THE ACTUAL 

OPERATING CHARACTERISTICS OF 

YOUR SYSTEM AS 

OPERATED 

BY YOU 



CALIBRATION PROBLEM-^ 

- ZERO ADJUSTMENT AND CONTROL 

- BLANK CORRECTION AND CONTROL 

- SLOPE ADJUSTMENT AND CONTROL 

- ERROR IN PREPARATION OF STANDARDS 

- UNCERTAINTY IN MEASUREMENT OF STANDARDS 

- CURVATURE IN USUALLY LINEAR SYSTEMS 

- INSTABILITY IN CURVED SYSTEMS 

- ILL-ADVISED ADJUSTMENT OF INSTRUMENT OR 
SYSTEM CONTROLS 



calibration curve must be restandardized day by day. One cannot automaticaiiy 
assume that the materials used as 'standards' are correct or have been prepared 
without contamination or loss, or have been measured without error. Therefore 
once the calibration curve has been restandardized, deliberate action must be taken 
to ensure that today's 'true average' will be not significantly different from its 
previous value. This introduces the concept of Complex Statistical Control. 

It should be noted that analytical recovery from individual samples is not under 
discussion here, although it may have some impact on the result in less 'rugged' 
analytical processes. Rather, we are concerned with ensuring that standards are 
used and interpreted properly, to avoid introducing bias between 'true averages' 
from day to day. It must always be kept clear that 'simple statistical control' 
determines only the range of variability expected. It defines the precision of the 
method. On the other hand, 'complex statistical control' addresses the variability 
of the 'true average'. It therefore maintains a degree of accuracy. 

Demonstrating Complex Statistical Control 

Whenever a system is restandardized there is always a significant probability that 
bias will be introduced. A check is required which will help to limit the range of 
this error. This is achieved by use of a control standard . The data in figure 7 is 
basically the same as figure 3) except that not only the range of variation but also 
the variation relative to an expected value must be examined. This difference 
represents the bias for that day's run. From day to day this bias will change. It 
may or may not be significant. It is the function of the control standard to monitor 
these changes. 

When only one analysis of a single control standard is available, it is clearly 
difficult to distinguish between the precision variability and the accuracy 
variability. However, the use of a control chart with limits based on within-run 
estimates of standard deviation will reveal, 

...11 



FIGURE 7: Instrumental response factors usually vary 

SOMEWHAT FROM DAY TO DAY. CALIBRATION ADJUSTS 
FOR THIS. But analytical ERRORS IN THE 
STANDARDS CAN LEAD TO INCORRECT CALIBRATION 
DECISIONS WHICH WILL AFFECT ALL MEASUREMENTS IN 
THAT RUN, 



OBSERVED= 



ACTUAL= K 



UNCERTAINTY^ 



= 1 



APPARENT 
RESPONSE 




TYPE I 
ERROR 



TYPE II 
ERROR 



SEQUENCE 
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a) an unexpected number of values outside the control limits but not grossly 
outside. These we may have to live with since they represent an acceptable 
level of between-run control. 

b) trends in the apparent average over short periods of time. These we should 
eventually correct since trends are a sign of determinate error rather than 
chance. 

c) occasional gross outliers beyond the level defined by a). These we must 
prevent from affecting calibration on a day-to-day basis. 



Extraordinary deviations may occasionally reflect an error in analysis of the 
control standard. But more frequently they are a direct indication of calibration 
bias influencing today's 'true average'. 

The data in figure 8a) might generate the control limit estimates shown. However 
this control status cannot be assumed to be good. This data may have been actually 
generated over several runs where the within-run standard deviation was known to 
be significantly better. As shown in figure 8b) the system appears to be out-of- 
control relative to within-run performance. But is it really? Is there a criterion 
for establishing an acceptable level of control over between-run variation? 

Control limits are often set at 3 times the standard deviation. In setting control 
limits for between-run performance it should be obvious that within-run standard 
deviation is too tight a basis. On the other hand, between-run standard deviations 
will reflect the current control status. If the process is not in good control, 
between-run standard deviations will be too loose to exert control. 

As a general rule of thumb, a ratio greater than 1.3 for between-run versus within- 
run standard deviation would be considered 'statistically significant' (based on the 
f-test for ratios of variance for about 30-60 degrees of freedom). While statistical 
significance is not directly indicative of practical significance, in this case it 
provides a basis for establishing control. Our experience indicates that the simple 
use of a control chart often has the effect of reducing the ratio of between-run to 

within-run standard deviation below this value. 
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FIGURE 8: If between-run effects are not controlled 

THEN CONTROL LIMITS BASED ON SUCH DATA CAN NOT 
EXERT CONTROL. A FACTOR OF 1.3 TIMES THE KNOWN 
WITHIN-RUN STANDARD DEVIATION WILL PROVIDE A 
BETTER ESTIMATE OF BETWEEN-RUN STANDARD DEVIATION 
FOR USE IN DEFINING MORE APPROPRIATE CONTROL. 



a) BETWEEN-RUN STD DEV. YIELDS LOOSE CONTROL LIMITS 



3s 



9 • 



UCL 



• • 



LCL 



b) WITHIN-RUN STD DEV. YIELDS EXCESSIVELY TIGHT LIMITS 



3s 



w 



• • • « 
• • • • « « * 



C) 1.3 X WITHIN-RUN STD DEV, EXERTS CONTROL 



• 1-3 OS. 



• • ♦ 
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Therefore, in establishing control limits for between-run performance, it is better 
to determine the within-run standard deviation and apply a factor of 1.3, than to 
use the actual between-run standard deviation. This allows room for short-term 
drift as well as imprecision and yet establishes active control. 

It is always possible to apply an acceptance limit approach for determining when 
action is absolutely required. This usually implies relaxing the control limit 
somewhat. However, it must be kept in mind that accuracy is at stake here, not 
just precision. It may be permissible to allow replicate results to vary by plus or 
minus 10% or 20%. But, the client does not expect the 'true average' to change by 
this amount. When a single control standard is being used, it is impossible to 
determine how much of today's deviation is random and how much represents a 
bias. It is even less possible to determine the source of this bias. 

Establishing Calibration Control 

Control can only be exerted when both a cause and a solution can be determined. It 
is always important to realize that excessive control may not only create bias, it 
may also prevent the cause of the problem from being identified. Figure 9 shows a 
few of the different types of problems that can be revealed by a control chart. 
Since this chart provides no solution, proper action cannot be taken. Therefore this 
process must remain out-of-control. 

In addition to curvature, a calibration will show variation in both slope and 
intercept over time. Figure 8 showed that changes were occurring but the 
operator had to guess the cause. More often than not this type of behaviour is not 
even apparent because the 'control' date is not plotted even if the control material 
analyzed and measured. The assumption is often made that this data reflects the 
capability of the process rather than lack of control over it. 

...13 



FIGURE 9: Several types of control problems seem to be 
OCCURRING. Are they within or between-run? 
Are they blank^ slope or sample related? 
Were proper adjustments made^ and on what basis? 



Is this system under control? 



1. THE control limits WERE DETERMINED DURING THIS PERIOD. 

2. THIS ERRATIC POINT MAY OR MAY NOT REFLECT A CALIBRATION 
ERROR, IT COULD BE AN ANALYTICAL OR MEASUREMENT ERROR. 

3. BETWEEN-RUN PRECISION HAS IMPROVED. THE CURRENT CONTROL 
LIMITS ARE TOO LOOSE BUT ARE RETAINED AS ACCEPTANCE LIMITS 
UNTIL A REASON CAN BE FOUND FOR CHANGING THEM. 

^. IS THIS DRIFT CAUSED BY BLANK OR SLOPE EFFECTS. ARE THE 
STANDARDS CHANGING OR IS IT THE INSTRUMENT? 

5. DRIFT HAS STABILIZED, ACCEPTANCE LIMITS ARE PERMITTING 
A SIGNIFICANT BIAS GIVEN THE APPARENT BETWEEN-RUN 
PRECISION. 

6. ALTHOUGH THIS RESULT LOOKS GOOD. IT IS ERRATIC RELATIVE 
TO RECENT VALUES, SOMETHING IS WRONG. 

7, THE BIAS HAS BEEN ELIMINATED DELIBERATELY BY ADJUSTING 
THE SLOPE. HOW DO WE KNOW THIS WAS CORRECT? PERHAPS THE 
BLANK CORRECTION HAS BEEN INCORRECT? 

8, NEW CONTROL LIMITS WERE FINALLY ESTABLISHED. THE CAUSE 
OF THE CYCLICAL DRIFT CANNOT BE DETERMINED AT THIS TIME 
BUT THE VARIATION IS TOLERABLE FOR THE INTENDED DATA USE. 
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When two control solutions are analyzed and measured it becomes possible to 
evaluate the nature of the change. If they differ in strength, so as to cover the 
bottom and top of the calibrated range, several factors can be evaluated over time 
by plotting a control chart, not just for the individual control standards but, more 
importantly, for their sum and difference values. If the variability of the high 
standard is greater than for the low standard, an overall lack of slope control is 
indicated. Intercept problems will be masked. Once this situation is controlled 
then; 



1) Their difference monitors slope trend control as long as the variation in 
slope from day to day is controlled. 

2) The variability of their difference monitors within-run precision as long as 
the slope is in-control, 

3) The pattern of variation in the sum of the two control values will indicate 
between-run control problems. If the slope is in-control these problems will 
be related to intercept or blank determination errors, 

^) If the blank is normal, an intercept problem suggests chronic curvature at 
the top end of an otherwise normally linear relationship. 



These patterns are demonstrated in figures 10 (and following). They reflect the 
calibration problems shown beside them. 

Accuracy Control 

We have indicated that repeatability is essentially process controlled (3 times the 
within-run standard deviation). Further we have shown that between-run bias can 
be placed under control (based on a factor of 1.3 times the within-run limits or 
about ^ S^.) However the question of accuracy control has not been resolved. 

It is important to realize that between-run variability usually reveals trends, i.e. 
drifting of the average over time. While it is acceptable for individual points to 



FIGURE 10: The results for two control standards can be 

PLOTTED versus EACH OTHER. THE DOTS ARE JOINED 
IN SEQUENCE TO REVEAL SYSTEMATIC VERSUS RANDOM 
PATTERNS, SYSTEMATIC ERRORS CAUSE BOTH RESULTS 
TO INCREASE OR DECREASE TOGETHER CAUSING LINES 
FROM LOWER LEFT TO UPPER RIGHT. THESE TWO 
PATTERNS WERE OBTAINED FROM THE SAME SYSTEM 
BEFORE AND AFTER A MAJOR INSTRUMENT OVERHAUL. 
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FIGURE 11: 



Two CONTROL STANDARDS OR SAMPLES CAN BE USED 
TO MONITOR THE TOP AND BOTTOM OF THE CALIBRATED 

RANGE. Their difference monitors slope control 

AND IS USED to ESTIMATE WITHIN-RUN STD. DEVIATION 

Their sum accentuates systematic changes if they 

ARE present and CAN BE USED TO ESTIMATE THE 
between-run STANDARD DEVIATION, If THE SYSTEM 
IS IN-CONTROL THE RATIO OF THESE ESTIMATES 
SHOULD NOT EXCEED 1.3 TO 1.5 
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FIGURE 12: 



Time sequence plots of the high and low controls 
and of their sums and differences reveal that 
after the overhaul the slope variation has 

STABILIZED. ThE LARGE VARIATION IN THE SUMS 
MUST BE DUE TO LACK OF CONTROL OVER THE BLANK 
OR INTERCEPT CORRECTION. 
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deviate by as much as ^ times S from expected, the average should not. Confi- 
dence in an average increases as the number (n) of values incorporated in it 
increases. The 'standard error' of an average is given by s/ yfn. Therefore, if the 
average is based on eight results, the standard error will be about 0.38 times the 
standard deviation. 

Therefore, given that the bias control limit for individual values is ^ times 5 it 
can be determimed that the control limit for an average of eight results in 
sequence will be about 1.5 times S- If the recent trend of control data is such 
that the addition of today's result will cause the average to differ from expected by 
more than this amount, it is reasonable to conclude that long-term accuracy is 
being affected even if today's result is still in control. 

Figure 13 reviews the various control limits that have been discussed. Their basis 
on the known within-run standard variation ensures control action will be taken, 
when necessary, to permit limited drift in bias while ensuring control of accuracy. 

Conclusion 

The important thing to keep in mind when considering use of control charts is not 
how they should be drawn, nor even how the control limits should be defined. If the 
objectives of a 'control chart' are not understood, it will not be plotted. These 
objectives include mechanisms for 

1) determining when calibration errors between-run are affecting the accuracy 
of sample results. 

2) characterizing the most significant sources of between-run problems. 

3) limiting between-run variation and yet retaining control over it. 

4) permitting trends and yet identifying unusual individual errors. 

5) demonstrating the level and nature of control being maintained. 

...15 
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The most important objective, however, is to become familiar with the character- 
istics of this particular analytical process as operated by you. 

A control chart need not be complicated by statistics. Its primary purposes are to 
identify outliers and to detect trends. Obviously once this has occurred, a solution 
is required. But, blind action is to be avoided at all cost. It is far worse to take 
the wrong action than to take no action at all. The more information that is 
recorded to assist in finding the right solution the better. Two controls are much 
more informative and useful than one. 

If resources are tight, precision control is less critical. It is already limited by the 
analytical process and technical proficiency. Accuracy however requires active 
control because of the nature of the human decision-making process. It needs you. 
It needs a control chart. 
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FIGURE 15: DIFFERENTIATION BETWEEN CONTROL LIMITS 
FOR PRECISION (5s^) j BIAS Ws^^ , AND 
ACCURACY Q.5 S^ . 



A SEQUENCE OF IN-RUN 
REPLICATION REVEALS 
VARIATION USED TO 
ESTIMATE S^. 




PRECISION IS 
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BETWEEN-RUN CONTROL STATUS? 



CONTROL 

PROPER ACTION TAKEN IN RESPONSE 
TO THE OBSERVATION OF 

UNEXPECTED BEHAVIOUR RELATIVE TO 
DEFINED LIMITS ABOUT AN 
EXPECTED VALUE OR MEAN 



PROPER ACTION 



ACTION BASED ON KNOWLEDGE 
OF PROPER SYSTEM FUNCTION^ AND 
EXPERIENCE WITH RESPECT TO 

PROBABLE CAUSES AND 
MOST APPROPRIATE SOLUTIONS 

If you don't know what went wrong 

don't FIX IT, 

If you don't have all the facts 

don't MAKE DECISIONS. 

If you're absolutely sure you can fix it... 

THINK IT OUT AGAIN. 

When you think it has been fixed 

PROVE IT. 

THEN DOCUMENT THE PROBLEM 

AND YOUR SOLUTION 
AND , UPDATE THE CONTROL CHART 
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